Deep Equilibrium Models for Snapshot Compressive Imaging

نویسندگان

چکیده

The ability of snapshot compressive imaging (SCI) systems to efficiently capture high-dimensional (HD) data has led an inverse problem, which consists recovering the HD signal from compressed and noisy measurement. While reconstruction algorithms grow fast solve it with recent advances deep learning, fundamental issue accurate stable recovery remains. To this end, we propose equilibrium models (DEQ) for video SCI, fusing data-driven regularization convergence in a theoretically sound manner. Each model implicitly learns nonexpansive operator analytically computes fixed point, thus enabling unlimited iterative steps infinite network depth only constant memory requirement training testing. Specifically, demonstrate how DEQ can be applied two existing SCI reconstruction: recurrent neural networks (RNN) Plug-and-Play (PnP) algorithms. On variety datasets real data, both quantitative qualitative evaluations our results effectiveness stability proposed method. code are available at: https://github.com/IndigoPurple/DEQSCI.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Single disperser design for compressive, single-snapshot spectral imaging

Recent theoretical work in “compressed sensing” can be exploited to guide the design of accurate, single-snapshot, static, high-throughput spectral imaging systems. A spectral imager provides a three-dimensional data cube in which the spatial information of the image is complemented by spectral information about each spatial location. In this paper, compressive, single-snapshot spectral imaging...

متن کامل

Single and multiple snapshot compressive beamforming

For a sound field observed on a sensor array, compressive sensing (CS) reconstructs the directionof-arrivals (DOAs) of multiple sources using a sparsity constraint. The DOA estimation is posed as an underdetermined problem expressing the acoustic pressure at each sensor as a phase-lagged superposition of source amplitudes at all hypothetical DOAs. Regularizing with an l1-norm constraint renders...

متن کامل

Multiple and single snapshot compressive beamforming.

For a sound field observed on a sensor array, compressive sensing (CS) reconstructs the direction of arrival (DOA) of multiple sources using a sparsity constraint. The DOA estimation is posed as an underdetermined problem by expressing the acoustic pressure at each sensor as a phase-lagged superposition of source amplitudes at all hypothetical DOAs. Regularizing with an ℓ1-norm constraint rende...

متن کامل

Sparsity Models for Hyperspectral Imaging and Compressive Sensing LIDAR

Virtually all types of imaging (including remote sensing) deal with high-dimensional signals that have low-dimensional structure that can be exploited. While classic models rely only on signals being bandlimited, more recent signal models are based on the notion that most signals can be written as a sum of just a few elements from a suitable dictionary (known as "sparsity"). Sparsity models hav...

متن کامل

A Hybrid Optimization Algorithm for Learning Deep Models

Deep learning is one of the subsets of machine learning that is widely used in Artificial Intelligence (AI) field such as natural language processing and machine vision. The learning algorithms require optimization in multiple aspects. Generally, model-based inferences need to solve an optimized problem. In deep learning, the most important problem that can be solved by optimization is neural n...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2023

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v37i3.25475